Providence
Initialization-Aware Score-Based Diffusion Sampling
Fassina, Tiziano, Cardoso, Gabriel, Corff, Sylvan Le, Romary, Thomas
Score-based generative models (SGMs) aim at generating samples from a target distribution by approximating the reverse-time dynamics of a stochastic differential equation. Despite their strong empirical performance, classical samplers initialized from a Gaussian distribution require a long time horizon noising typically inducing a large number of discretization steps and high computational cost. In this work, we present a Kullback-Leibler convergence analysis of Variance Exploding diffusion samplers that highlights the critical role of the backward process initialization. Based on this result, we propose a theoretically grounded sampling strategy that learns the reverse-time initialization, directly minimizing the initialization error. The resulting procedure is independent of the specific score training procedure, network architecture, and discretization scheme. Experiments on toy distributions and benchmark datasets demonstrate competitive or improved generative quality while using significantly fewer sampling steps.
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- Europe > Switzerland (0.04)
- Europe > France > Hauts-de-France > Nord > Lille (0.04)
- (4 more...)
- Information Technology > Artificial Intelligence > Vision (1.00)
- Information Technology > Artificial Intelligence > Representation & Reasoning (1.00)
- Information Technology > Artificial Intelligence > Natural Language (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.46)
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.05)
- North America > United States > Rhode Island > Providence County > Providence (0.04)
- North America > United States > New Jersey > Mercer County > Princeton (0.04)
- (3 more...)
- Oceania > Australia > New South Wales (0.04)
- Oceania > Australia > Victoria (0.04)
- North America > United States > Rhode Island > Providence County > Providence (0.04)
- (5 more...)
- Research Report > Experimental Study (0.93)
- Overview (0.67)
- Banking & Finance > Trading (0.67)
- Health & Medicine (0.67)
- Energy > Power Industry (0.67)
- Energy > Renewable (0.46)
- North America > United States > California > Los Angeles County > Long Beach (0.14)
- North America > Canada > Newfoundland and Labrador > Labrador (0.04)
- North America > United States > Washington > King County > Seattle (0.04)
- (14 more...)
- Information Technology > Artificial Intelligence > Vision (1.00)
- Information Technology > Artificial Intelligence > Representation & Reasoning (1.00)
- Information Technology > Artificial Intelligence > Natural Language (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks (1.00)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- North America > United States > Rhode Island > Providence County > Providence (0.04)
- Europe > Switzerland > Basel-City > Basel (0.04)
- (2 more...)
- Health & Medicine (0.67)
- Information Technology (0.46)
- Asia > Singapore (0.04)
- North America > United States > Rhode Island > Providence County > Providence (0.04)
- North America > Canada > Alberta (0.14)
- North America > United States > Texas > Travis County > Austin (0.14)
- North America > United States > Rhode Island > Providence County > Providence (0.04)
- (7 more...)
- Europe > Finland > Uusimaa > Helsinki (0.04)
- North America > United States > South Dakota > Minnehaha County > Sioux Falls (0.04)
- North America > United States > Rhode Island > Providence County > Providence (0.04)
- (3 more...)
- North America > United States > Rhode Island > Providence County > Providence (0.04)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- North America > United States > New Jersey > Mercer County > Princeton (0.04)
- (5 more...)
- North America > United States > Rhode Island > Providence County > Providence (0.04)
- North America > United States > New Jersey > Mercer County > Princeton (0.04)
- North America > United States > Maine > Cumberland County > Brunswick (0.04)
- (6 more...)